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DETAILED ACTION 

Claim Rejections - 35 USC §103 

1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claimsl-17, 21-58, 62-76 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
DaGraca et al (US 6,646,676 Bl) in view of Brodsky et al. (US 6,731,805). 

Re claims 1 and 8, DaGraca teaches a method for collecting, selecting and transmitting 
data to selected stations on a network(FIGURE 2 of DaGraca, video data are generated and 
transmitted from cameras 201-202, which are disposed remotely in a network 211, video data are 
archived or recorded for subsequent selective viewing, see col. 5, line 9-15; and either local 
station 203 or remote station 210, see col. 4, line 30-40, col. 12, line 31-39), the transmitted data 
including at least one of a compressed digital still image and compressed digital motion video 
(201 and 202 of fig. 2, Note the well known MPEG encoder (MPEG-1, MPEG-2, MPEG-4, and 
MPEG-7) encodes the captured images including still image (intraframe coding) and motion 
image (interframe coding) to produce encoded/compressed still image and encoded/compressed 
motion image), the method comprises the steps of: 

a. collecting data based on an event occurring at the remote location (col. 5, line 16-23), 
wherein collected data is related to a scene (col. 8, lines 57-67); 
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generating from collected data motion histogram values using dc-images of the scene 
(col. 8, lines 57-coL 9, linel2); 

b. generating a prioritized signal from indicating a priority (col. 6, line 1-5, 27-38, and/or 
coL 12, line 28-29, video data can also be prioritized by the description scheme instantiator, see 
col. 10, line 35-67; See also 340 of fig. 2, Note priorities can also be assigned as to the order of 
response activities); 

c. transmitting the prioritized signal to a receiving station located on a network (col. 6, 
line 47-67, col. 12, line 20-45); and 

d. managing the transmitted prioritized signal at the receiving station (coL 12, line 20-45, 
i.e. prioritizing response activities is a form of managing prioritized signal at the local and/or 
remote surveillance station). 

It is noted that DaGraca further suggests the well-known technique for detecting scenes 
changes using dc-images using color histogram from the dc-images (col. 8, lines 60-65) and 
modifications of the scene change detection technique may be mad (col. 11, lines 47-49). 
However, DaGraca does not particularly teach generating from the collected date motion 
histogram values for regions of the scene, motion histogram values suitable for graphically 
depicting scene changes over time as claimed. 

Brodsky teaches the control unit (20 of fig. 1, col. 14, lines 18-56) for generating from 
the collected date motion histogram values for regions of the scene (col. 15, lines 47-65), motion 
histogram values suitable for graphically depicting scene changes (figs. 5A and 5B) and the 
video signal is compressed (col. 5, lines 40-45). 
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Therefore, taking the teachings of DaGraca and Brodsky as a whole, it would have been 
obvious to one of ordinary skill in the art to incorporate the teachings of Brodsky into the system 
of DaGraca in order to provide a highly accurate system and method for detecting events in 
surveillance video and images. Doing so would allow the receiving site to be able to provide data 
analysis and processing services for commercial purposes, thereby saving on the costs entailed in 
the development of independent computerization and data processing capabilities. 

Re claim 2, DaGraca further teaches the prioritizing step the time and location of the 
event in the transmitted prioritized signal (see col. 6, line 27-38). 

Re claim 3, DaGraca further teaches wherein the collected data includes an image signal 
and wherein the transmitted prioritized signal includes an image component (col. 6, line 27-38). 

Re claim 4, DaGraca further teaches wherein the collected data defines an original scene 
and wherein the transmitted data is generated in response to a modification of the original scene, 
the method further comprising: 

a. collecting the data on a pre-selected basis (col. 6, lines 63-67, Note user preferences 
are pre-selected basis; defining the selection of the event); 

b. defining and transmitting an original scene to the remote station (I frames is considered 
original fi-ame); 

c. comparing subsequent scenes to the original scene (col. 8, lines 61 and 62); 

d. transmitting only those subsequent scenes differing fi-om the original scene. (See col. 
6, line 47-67, col. 8, line 43 - col. 9, line 67 i.e. feature extraction and augmentation of the 
bitstream. In these segments, the original scene may be established by the I- frame, modification 
to the original scene may be effected by the P Page 5 and/or B-firame as expected in the disclosed 



Application/Control Number: 09/853,274 Page 5 

Art Unit: 2621 

MPEG coding scheme, which also governs transmission/coding of only difference data, and also 
content descriptions, which is governed by MPEG-7. Frames to be viewed for security interest 
are "selected". These selected frames are based on an "pre-defined" events, see col. 12, line 1- 
18). 

Re claim 5, DaGraca further teaches wherein the comparing step is completed at the 
camera (see col. 5, line 1. Note: encoding is MPEG, which govems the comparing step i .e. 
frame differencing, col. 8, lines 61-62). 

Re claim 6, DaGraca further teaches wherein the data is in the form of digital pixels and 
wherein the comparing step comprises identifying only those pixels altered from the original 
scene. (Note: MPEG encoding govems pixel data and differential encoding i.e. alteration of 
difference pixels from the original scene establishes by the I-frame; and percentage are then 
determined from the image itself by using the dc value of the color of a macro-block as the color 
of every pixel that belongs to that macroblock. This briefly illustrates how the dominant color 
can be determined from the output of the symbol processor (450 of fig. 4)). 

Re claim 7, DaGraca further teaches the step of generating a change histogram from the 
change information created in the comparing step (see col. 8, line 62-65). 

Re claims 9 and 16, DaGraca further teaches the step of tagging each transmitted image 
with unique identifying data (see col. 6, line 47-67, i.e. the tagging data is governed by the 
content descriptions). 

Re claim 10, DaGraca further teaches wherein the tagging step is performed at the remote 
location (based on figs. 2-3, the content description i.e. tagging takes place at the surveillance & 
control system 300, which is at a remote location in the network). 
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Re claims 1 1 and 25, DaGraca further teaches wherein the identifying data includes the 
date and time of the data defining a scene (see col. 6, lines 27-67. In this segment, the video data 
may also be tagged by user inputs, which include time/date customization). 

Re claims 12 and 26, DaGraca further teaches wherein the identifying data further 
includes the duration of the data defining a scene (see col. 6, line 27-67. In this segment, select 
frames for summarizing video of interest implies a specific duration of a security scene). 

Re claims 13 and 27, DaGraca further teaches a plurality of cameras and wherein the 
identifying data further includes a camera identifier (see fig. 2, the plurality of cameras is 
governed by 201-202, and since the cameras may be switched and video data may be routed in 
the network, see col. 7, line 1-8, camera identifiers would have been inherent and necessitated; 
Note Using MPEG-7 descriptors, and training data, it becomes possible to extract security events 
such as accidents, assaults, traffic violations, etc. NZ-NS surveillance can also be used in crowed 
stores to detect shop-lifting, or in casinos to detect cheating; this indicates that the camera has 
been identified). 

Re claims 14, 28, 29, and 30, DaGraca further teaches a visual monitor at the remote 
location, wherein transmitted data may be selectively displayed at the monitor (see fig. 2, 208 or 
210 for example, also col. 4, line 60-64, col. 12, line 31-45. Selective viewing has been 
previously discussed in claim 1); wherein the managing step comprises generating an alarm at 
the receiving station (see col. 5, line 16-23, col. 12, line 31-39). 

Re claim 15, DaGraca further teaches wherein transmitted data is displayed at the 
monitor in near real-time (the desire to achieve real-time performance is disclosed in DaGraca, 
see col. 3, line 42-52). 
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Re claim 17, DaGraca further teaches wherein the unique identifying data is displayed 
with the displayed data (see col. 6, line 27-47, which discloses selected frames and identifying 
data are being examined). 

Re claim 21, DaGraca further teaches the step of storing the transmitted data at the 
remote location (see fig. 2: 207 and/or 208, 210, i.e. any of these elements is capable of remote 
storage over the network). 

Re claim 22, DaGraca further teaches the step of retrieving the data from the stored data 
on command (see col. 5, line 9-15, which discloses user selected viewing of stored images, thus 
implying upon command). 

Re claim 23, DaGraca further teaches the step of tagging each transmitted image with 
unique identifying data (see col. 6, line 47-67, i.e. the tagging data is governed by the content 
descriptions). 

Re claim 24, DaGraca further teaches wherein the tagging step is performed at the remote 
location (based on figs. 2-3, the content description i.e. tagging takes place at the surveillance & 
control system 300, which is at a remote location in the network). 

Re claim 31, see claim 21 . 

Re claims 32-37, DaGraca further teaches the limitations as recited in these claims have 
been analyzed and rejected w/r to claims 1-7, 9-17 and 21-31. 

Re claim 38, DaGraca further teaches including a central management system and 
wherein the prioritizing step occurs after the collected data is sent to the management system 
(fig. 2:300, see also discussion in claim 1 , also col. 5, line 25 - col. 6, line 67). 
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Re claim 39, DaGraca further teaches retransmission of the data based on the 
prioritization of the data at the central management system (see col. 5, line 25 - coL 6, line 67, 
which discloses detecting security events based on prioritization schemes), and then signaling 
such events to the rest in the network i.e., retransmission based on a customization scheme). 

Re claim 40, DaGraca further teaches the retransmission step includes transmitting the 
data to selected recipients based on the prioritization step (see discussion of claim 39, also 
especially col 6, line 27-46 and col. 12, line 20-29). 

Re claim 41, DaGraca further teaches wherein the retransmission step includes generating 
a visual icon on a graphic display at a remote location (see col. 12, line 21-29, i.e. PEP window 
serves as a visual icon). 

Re claim 42, DaGraca further teaches the retransmission step includes generating a voice 
signal at selected remote locations (col. 12, line 21-29, i .e. recorded message). 

Re claim 43, DaGraca further teaches the retransmission step includes a sub-step of 
defining a recipient hierarchy and retransmitting in sequence in accordance with the hierarchy 
(see col. 12, line 21-29, i.e. assigned priorities). 

Re claim 44, DaGraca is silent in disclosing the step of providing a positive response 
signal to the central management system for indicating that a retransmitted signal has been 
received by a selected recipient. However, DaGraca discloses that Page 9 upon detection of an 
event, video and control signals are routed to other devices in the network for monitoring and 
controls (see col. 12, Line 20-29). In order for data to be properly routed through the network, 
acknowledgements of transmission and receipts from the devices in the network are inherent and 
necessitated. 
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Re claim 45, DaGraca further teaches the step of password encoding recipients (see col. 
6, line 18-46, col. 7, line 1-8, the "user" as disclosed is understood as an authorized user). 

Re claim 46, DaGraca further teaches the step of managing the system through the central 
management system by a selected recipient after a retransmitted message has been received (see 
col. 6, line 18-46). 

Re claim 47, DaGraca further teaches wherein the prioritizing step occurs prior to the 
transmitting step. The limitations have been analyzed and rejected w/r to claims 1-3 above. 

Re claim 48, DaGraca further teaches wherein the prioritizing step occurs at a first 
hierarchy prior to the transmitting step and at a second hierarchy after the transmitting step (see 
col. 6, line 27-38, which reads on the disclosed priority of contact). 

Re claim 49, DaGraca fiirther teaches the step of generating a notification signal in 
response to a transmitted prioritized signal (see col. 6, line 35-38, i.e. sending alerts). 

Re claim 50, DaGraca fiirther teaches the notification signal is transmitted to selected 
recipients on a network (see col. 6, line 27-38, which discloses the recipients are selected 
recipients). 

Re claim 51 , DaGraca further teaches wherein the notification signal is repeatedly 
transmitted until a selected recipient responds to the notification signal (see col. 6, line 27-38, 
which discloses a "no response" provision. Thus, repeating the notification in the event of no 
response is implied). 

Re claim 52, see claims 48-51 . Re claim 53, which further recites wherein the 
notification signal is transmitted to monitoring stations on a network (see fig. 2, col. 6, line 27- 
38, col. 12, line 20-45). - 



Application/Control Number: 09/853,274 Page 10 

Art Unit: 2621 

Re claim 54, DaGraca further teaches wherein the notification signal is transmitted via 
telephonic means (see col. 6, line 27-38). 

Re claim 55, DaGraca further teaches wherein the notification signal is transmitted via e- 
mail (see col. 6, line 27-38). 

Re claim 56, DaGraca further teaches wherein the e-mail further includes an attachment 
including additional, event specific data (see col. 6, line 27-38). 

Re claim 57, DaGraca further teaches wherein the attachment is image data (see col. 6, 
line 27-38). 

Re claim 58, DaGraca further teaches wherein the receipt and response to the notification 
signal is password protected (see discussion in claim 45. Also, the authorized user access implies 
password protection). 

Re claim 62, see discussion in claims 1-4, 43-48. 

Re claim 63, see discussion in claims 6-7. 

Re claim 64, see discussion in claims 1-4, 15. Re claim 65, which further recites 

including the step of compressing the data prior to the transmitting step (see col. 5, line 1-8). 

« 

Re claim 66, DaGraca further teaches wherein the compressing step further includes 
minimizing the amount of data to be transmitted without any loss of critical change data (see 
claim 65; minimizing the amount of data to be transmitted without any loss of critical change 
data is inherently governed by MPEG-based coding). 

Re claim 67, DaGraca further teaches the steps of defining the data in blocks of data and 
tagging each block of data with a unique identifier for enhancing storage, search and retrieval 
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(see discussion in claims 65-66; MPEG-based coding governs defining image data into blocks, 
and coding them according to block data identifiers) i.e. tags). 

Re claim 68, DaGraca fiirther teaches the step of quantifying the amount of change 
between scenes (see discussion in claims 65-67; MPEG-based coding governs quantifying the 
amount of change between scenes. That is the whole essence of MPEG-based coding). 

Re claim 69. DaGraca further teaches the steps of quantifying the amount of change 
between scenes and reporting such as an indication of level of motion (see discussion in claims 
65-68, MPEG-based coding governs quantifying change between scenes as motion vector). 

Re claim 70, DaGraca further teaches the step of ignoring anticipated or minimal changes 
in a scene by applying pre-selected criteria (see col. 12, line 1-19, which defines this aspect 
based on MPEG coding). 

Re claim 71, DaGraca further teaches the step of blocking of specified regions of a scene 
to further enhance the monitoring, transmission and definition of the changes in the scene of a 
fi'ame-to-frame basis (MPEG-based coding also governs this aspect via non-coding of 
background data, only the change between scenes). 

Re claim 72, DaGraca further teaches wherein the managing step further includes the step 
of correlating correlate motion between two or more cameras to determine if a motion detection 
event should be identified in order to eliminate false alarms (see col. 12, line 1 -20). 

Re claim 73, DaGraca further teaches the step of controlling all functions and steps from 
a single interactive monitor screen (see fig. 2: 300 and its respective disclosure). 

Re claim 74, DaGraca further teaches the step of providing simultaneous access for two 
or more monitor screens each allowing functions of the system to be controlled by that 
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interactive monitor (see col. 12, line 20-45, i.e. local and remote monitoring and interactive 
controls are capable). 

Re claim 75, DaGraca further teaches the step of detecting the appearance or 
disappearance of an object (col. 11, line 35-46). 

Re claim 76, DaGraca further teaches wherein the notification step includes detection of 
the presence of unauthorized events in a monitored zone and the. transmitting step includes 
transmitting the detection to selected remote stations on a network on a near Page 13 real-time 
basis (see discussion in claims 1-4 and 1; detection of security events as disclosed in DaGraca 
implies unauthorized events in a monitored zone. This detection process is real-time). 

3. Claims 18-20, 77 are rejected under 35 U.S.C. 103(a) as being unpatentable DaGraca et 
al (US 6,646,676 Bl) in view of Brodsky et al. (US 6,731,805) as applied to claims 1-4, 14, and 
16, and further in view of Kohno et al, US 2003/0048356 Al. 

Re claim 18, the combination of DaGraca and Brodsky fails to further disclose as claimed 
the monitor further includes a map of the scene. However, such feature is well known and 
obvious as evidenced by Kohno (fig. 5, para 0062-0068), which utilizes a monitor with a map of 
the scene to provide a layout of the surveillance area and to indicate to a user the current state of 
the selected video camera. Kohno further suggests the disclosure is to be accorded the broadest 
interpretation so as to encompass all such modifications and equivalent structures and functions. 

Therefore, taking the teachings of DaGraca, Brodsky, and Kohno as a whole, it would 
have been obvious to one of ordinary skill in the art to incorporate a monitor including a map of 
the scene of Kohno into the combined method of DaGraca and Brodsky in order to provide the 
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occurrence event within the selected camera field of view included the map to a display for 
viewing so that the camera is updated in the image information display region, the property to 
confirm that even an image having little movement (image difference) is normally received and 
is operating can be easily improved as suggested by Kohno. 

Re claim 19, DaGraca further teaches a plurality of cameras and wherein an icon 
representing each camera is provided on the map above). (See rejection of claim 18 Re claim 20, 
which further recites including an indicator that is activated when the data from a specific 
camera is displayed on the monitor and deactivated at other times (See Kohno, para 0067-0068). 

Re claim 77, DaGraca further teaches wherein the notification step includes routing 
detected events, whereby the location of the incident may be visually located on a map at the 
remote station. (See discussion in claims 17-18 above). 

4. Claims 59-61 are rejected xmder 35 U.S.C. 103(a) as being unpatentable over DaGraca et 
al (US 6,646,676 Bl) in view of Brodsky et al. (US 6,731,805) as appUed to claims 3 and 21 
above and further in view of Leung et al, (US 6,643,779). 

Re claim 59,the combination of DaGraca and Brodsky does not particularly disclose 
keeping a log of personnel access and an image of the access as claimed. However, such 
convention is well known and obvious as evidenced by Leung (see col. 3, line 38 - col. 4, line 10, 
col. 5, line 63-67), which discloses an internet-based security terminal that keeps track of access 
log and also suggests having a camera to capture video at the security terminal for authentication 
of personnel access. 
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Therefore, taking teachings of DaGraca, Brodsky, and Leung as a whole, it would have 
been obvious to one of ordinary skill in the art to incorporate the features of keeping a log of 
personnel access and an image of the access of Lexmg into the combination method of DaGraca 
and Brodsky in order to provide different security levels to satisfy different security requirements 
for devices. Doing so would allow the user that is capable of accessing the computer network to 
setup and maintain the security system. 

Re claim 60, DaGraca further teaches the step of searching the database by any 
combination of specific individual, class of individual, by successful accesses, by unsuccessful 
accesses, by specific portal of entry with qualifiers of time, day, and location (See Leung, col. 3, 
line 38 - col. 4, line 10). 

Re claim 61, the limitations as claimed have been analyzed and rejected w/r to claims 59- 
60 above. 

Response to Arguments 

5. Applicant's arguments filed 04/23/2007 have been fully considered but they are not 
persuasive. 

The applicant argued that DeGraca clearly teaches away from the step including 
generating motion histogram value for regions of the scene, the motion histogram value being 
suitable for graphically depicting magnitude of sensed scene change over time, page 12 of the 
remarks. 

The examiner respectfully disagrees with the applicant. It is submitted that DeGraca 
teaches the detection scene change (col. 8, line 57-col. 9, line 12) using dc-images, wherein the 
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color histogram or color structure histogram are determined from the dc-images of the 
monitoring area. Brodsky teaches the control unit (20 of fig. 1, col. 14, lines 18-56) for 
generating from the collected date motion histogram values for regions of the scene (col. 15, 
lines 47-65), motion histogram values suitable for graphically depicting scene changes (figs. 5 A 
and 5B), and the control unit is used in scene change detection. Therefore, one skill in the art 
v/ouldbe obviously motivated (DeGraca: col. 12, lines 47-49; and Brodsky: col. 16, lines 13-19) 
to combine DeGaca and Brodsky for providing any common processing required by the two or 
more techniques may be consolidated for efficiency. 

Conclusion 

6. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
AppUcant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS fi*om the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed imtil after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated fi"om the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS fi-om the date of this 
final action. 



Application/Control Number: 09/853,274 
Art Unit: 2621 



Page 16 



Contact Information 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Tung Vo whose telephone number is 571-272-7340. The 
examiner can normally be reached on Monday-Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on 571-272-7418. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-^3a-tOOO: 




Tung Vo 
Primary Examiner 
Art Unit 2621 



